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FROM RANDOM PROCESSES TO GENERALIZED FIELDS: A 
UNIFIED APPROACH TO STOCHASTIC INTEGRATION 
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Abstract. The paper studies stochastic integration with respect to Gaussian pro- 
cesses and fields. It is more convenient to work with a field than a process: by 
definition, a field is a collection of stochastic integrals for a class of deterministic 
integrands. The problem is then to extend the definition to random integrands. An 
orthogonal decomposition of chaos space of the random field leads to two such ex- 
tensions, corresponding to the Ito-Skorokhod and the Stratononovich integrals, and 
provides an efficient tool to study these integrals, both analytically and numerically. 
For a Gaussian process, a natural definition of the integral follows from a canonical 
correspondence between random processes and a special class of random fields. 



1. Introduction 

While stochastic integral with respect to a standard Brownian motion is a well-studied 
object, integration with respect to other Gaussian processes is currently an area of 
active research, and the fractional Brownian motion is receiving most of the attention 
[H El El El m [m [121 [ini etc.] The objective of this paper is to define and investigate 
stochastic integrals with respect to arbitrary Gaussian processes and fields using chaos 
expansion. The motivation comes from the paper by Alos et al. [2] and the book by 
P. Major \1A\. 

In [2], the authors study stochastic integration with respect to the Gaussian process 
£ K{t,s)dW{s), where K is a suitable kernel function and ly is a standard Brownian 
motion. In [H], the author studies stochastic integration with respect to generalized 
Gaussian fields. While p] and [H] pursue different goals and work with different 
objects, generalized fields and the chaos expansion, appearing in both [2J and [14j . 
are the unifying ideas. 

A generalized Gaussian field X over a Hilbert space H is a continuous linear mapping 
/ I— i> from H to the space of Gaussian random variables. The correspond- 

ing chaos space Hx is the Hilbert space of square integrable random variables that 
are measurable with respect to the sigma-algebra generated by X(/), / G H. The 
chaos expansion is an orthogonal decomposition of H^: given an orthonormal basis 
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{^rn, m > 1} in Hx, a square integrable H- valued random variable rj has a chaos 
expansion r] = Y.m>i Vm^m, with r]m = ^(v^m) e H. 

The definition of a generalized Gaussian field X already provides the stochastic inte- 
gral for non-random / G H. As a result, given the chaos expansion of a random 
element r) from H^, the definition of the stochastic integral X{r)) requires an extension 
of the linearity property of X to linear combinations with random coefficients. Two 
"natural" extensions of this property lead to the Ito-Skorokhod and the Stratonovich 
stochastic integrals; see Definition 14.61 below. Both integrals can be expressed using 
the Malliavin derivative and divergence operator on the chaos space H^. 

Even for non-random /, when there is no difference between the Ito-Skorokhod and 
the Stratonovich interpretations of X(/), there are often several ways of computing 
X(/). It is most convenient to work with a white noise over H, that is, a zero- mean 
generalize Gaussian field such that E(X(/)X((7)) = {f,g)-H. for all f,g eH. It turns 
out that, for every zero- mean Gaussian field X over H, there exists a different (usually 
larger) Hilbert space H' such that X is a white noise over H'. Moreover, the space H' is 
uniquely determined by X. On the other hand, every zero-mean Gaussian field X over 
H can be written in the form X(/) = Q5(/C*/), / G H, where /C* is a bounded linear 
operator on H and ?B is a white noise over H, although this white noise representation 
of X is not necessarily unique. Thus, different white noise representations of X lead to 
different formulas for computing X(/), and the chaos expansion is an efficient way for 
deriving those formulas. In particular, for both deterministic and random /, chaos 
expansion provides an explicit formula for X(/) in terms of the Fourier coefficients of 
the integrand /. 

To define stochastic integral with respect to a Gaussian process X = X{t), t G 
[0,T], we construct a Hilbert space Hx and a white noise 03 over Hx such that 
X{t) = ?B(xt), where Xt is the characteristic function of the interval [0,t]. The space 
Hx is uniquely determined by X; for example, the Wiener process on (0, T) has 
Hx = -L2((0,T)). Then the equality 



is a canonical definition of the stochastic integral with respect to X. 

In some situations, given a Gaussian process X = X(t), t G [0,T], it is possible to 
find a generalized Gaussian field X over a Hilbert space H so that X(t) = X(xi)- 
Even though X is not necessarily a white noise over H, the resulting definition of the 
stochastic integral. 



coincides with the fll.ll) . while the space H can be more convenient for computations 
than the space Hx- For example, fractional Brownian motion with the Hurst pa- 
rameter bigger then 1/2 has a rather complicated space Hx, but can be represented 
using a generalized Gaussian field over H = L2((0,T)). 

The paper is organized as follows. Section 2 provides the definition and properties of 
generalized Gaussian fields and establishes connections with the Gaussian processes. 



(1.1) 
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Section 3 introduces the chaos expansion and the Wick product, both necessary for the 
definition and analysis in Section 4 of the stochastic integrals with random integrands. 

The main contributions of the paper are: 

(1) Two white noise representations of a zero-mean generalized Gaussian field 
(Theorem 12. 4p : 

(2) A connection between generalized Gaussian fields over L2((0,T)) and pro- 
cesses that are representable in the form K{t, s)dW{s) (Theorem 12. 7p : 

(3) Chaos expansions of the Ito-Skorokhod and Stratonovich integrals (Theorem 

(4) Investigation of the equation u{t) = 1 + u{s)dX{s) for a class of Gaussian 
random processes X (Theorem 14. 8p . 

In particular, we establish the following result. 

Theorem 1.1. Let X be a zero-mean generalized Gaussian field over L2{{0,T)) and 
Xit) = X{xt)- Then the solution of the ltd equation 

u{t) = 1 + / u{s)dX{s) 
Jo 

is unique in the class of square integrable J-"^ -measurable processes and is given by 



2. Generalized Gaussian Fields 

Let (f2, JF, P) be a probability space and V, a linear topological space over the real 
numbers M. Everywhere in this paper, we assume that the probability space is rich 
enough to support all the random elements we might need. 

Definition 2.1. (a) A generalized rajidom field overY is a mapping 
X : Q X V ^ M. with the following properties: 

(1) For every / G V, X(/) = X(-, /) is a random variable; 

(2) For every a,P eR and f,g e V, X(a/ + Pg) = aX{f) + (3X{g); 

(3) // lim fn = fin the topology ofV, then lim X{fn) = X{f) in probability. 

n— ►oo n— >oo 

(b) A generalized random field X is called 

• zero-mean, if EX(/) = for all f G V; 

• Gaussian, if the random variable X{f) is Gaussian for every / G V. 

For Example, if W = W{t), < t < T, is a standard Brownian motion on 
(i7, JF, P), then X{f) = f{t)dW{t) is a zero-mean generalized Gaussian field over 
L2((0,T)); note that 

(2.1) mifn) - X(/)P = C \fn{t) - f{t)\'dt. 

Jo 
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More generally, if is a bounded linear operator on L2((0,T)), then 

(2.2) X(/)= f {Mm)dW{t) 

Jo 

is a zero-mean generalized Gaussian field over L2((0,T)). In fact, by Theorem 12.6( b) 
below, every zero-mean generalized Gaussian field over -L2((0, T)) can be represented 
in the form ( 12. 2p with suitable M. and W . We will also see that the fractional 
Brownian motion on [0, T] with Hurst parameter bigger than 1/2 can be interpreted 
as a zero-mean generalized Gaussian field over L2((0,T)). 

Let H be a real Hilbert space with inner product (■, Oh and norm || ■ ||h = a/ (■, Oh- 
The following is a useful property of generalized Gaussian fields over H. 

Theorem 2.2. For every zero-mean generalized Gaussian field X over a Hilbert space 
H, there exists a unique bounded linear self-adjoint operator TZ on H such that 

(2.3) E(X(/)X((?)) = (7^/, g)u, f,geU. 

Proof. Equality (12.31) implies that the operator TZ, if exists, must be unique. To es- 
tablish existence of TZ, denote by H the Hilbert space -L2(^, ^, P) of square integrable 
random variables. By Definition 12. 11 the mapping / i— > X(/) defines a continuous lin- 
ear operator from H to H (recall that, for Gaussian random variables, convergence 
in probability implies mean-square convergence). Therefore, there exists a positive 
number C such that, for every / G H, 

(2.4) mmi = m{f)\'<c\\fru- 

Fix / G H and consider the linear functional F on H defined by F{g) = E(X(/)X(5')). 
By (12. 4p . this functional is bounded: 

\F{g)\ = |E(X(/)X((7))| < ^E\X{f)\Wmi9W < C\\f\\u\\9\\n, 

and therefore, by the Riesz Representation Theorem, there exists a unique hf E H 
such that F{g) = E(X(/)X((7)) = {hf,g)ii. Define the operator TZ by TZf = hf. 
By construction, this operator is linear; it is bounded by (12. 4p . A bounded linear 
operator satisfying (12.31) automatically satisfies {'JZf,g)ii = (/, 7^5')h and is therefore 
self- adjoint. □ 

Definition 2.3. (a) The operator TZ from Theorem \2.2\ is called the covariance 
operator ofX. (b) A white noise overU is a zero-mean generalized Gaussian field 
with the covariance operator equal to the identity operator. 

Note that if TZ is the covariance operator of X and TZf = 0, then X(/) = (P-a.s.) 
Writing ker(7^) to denote the zero-space of TZ, we have a direct sum decomposition 
H = ker(7^) ker(7^)-'", where keT(TZ)~^ is the orthogonal complement of keriTZ). As 
a resuh, if / = /i + /2, with /i G ker(7^), /a G ker(7^)^, then X(/) = X(/2). We say 
that the Gaussian field is non-degenerate if ker(7^) = 0. 

We show next that every zero-mean Gaussian random field over a Hilbert space can 
be reduced to a white noise in two different ways. 



STOCHASTIC INTEGRATION 



5 



Theorem 2.4. (a) For every zero-mean generalized Gaussian field X over a Hilbert 
space H, there exist a bounded linear operator IC on H and a white noise ?B over H 
so that /C/C* is the covariance operator of X and, for every / G H, 

(2.5) = ®(/C7); 

as usual, JC* denotes the adjoint of K. 

(b) For every zero-mean non- degenerate generalized Gaussian field X over a Hilbert 
space H, there exists a Hilbert space Hti such that H is continuously embedded into 
H-ji and X extends to a white noise over H-jz- 



Proof, (a) By construction, the covariance operator TZ oi a generahzed Gaussian field 
is non-negative definite, bounded, and self-adjoint on H. Indeed, 71 is bounded on H 
by Theorem 12.21 and, for every / and g from H, we have 

(7^/,/)H=E(X(/))'>0; 

(7^/, g)u = E(X(/)X(^7)) = E{X{g)X{f)) = {TZg, f)u = (/, ng)u. 

Therefore, by a standard result from functional analysis (see, for example, [H page 
923]) there exists a bounded linear operator /C on H such that 71 = K.K.*; this operator 
/C is not necessarily unique. 

Next, let /C*(H) = {/C*/, / G H} be the range of IC*, which is a closed linear subspace 
of H. Denote by /C*(H)-'- the orthogonal complement of /C*(H) in H. Then, for every 
/ G H, there exists a unique pair (/i,/2), with fi G H, /2 G /C*(H)-'-, such that 
/ = /C*/i + /2. This orthogonal decomposition of / implies 

(2.6) il/il^ = l|/C7i||^ + ll/2ll^, 
and 

(2.7) E(X(/i))' = (/C/C7i,/i)h = ||/C7i||h. 
Define 

5(/)=X(/i). 

Then X is a generalized Gaussian field over H: if lim — = 0, then, by (12.61) 

n— »oo 

and flO) . 

lim E(X(/) - Xifn)Y = lim E(X(/i - /i,„))' = lim ||/C*(/i - /i,„)l|^ = 0. 

n— >oo n— >oo n— >oo 

Let 03 be a white noise over H, independent of X. The same arguments show that 
*B, defined by 

^(/) = W2), 
is a generalized Gaussian field over H. Define 

^(/) = X(/) + ^(/). 

Then *B is a generalized Gaussian field over H, being a sum of two independent 
generalized Gaussian fields over H, and, by definition, Q3(/C*/) = X(/C*/) = X(/). 
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Moreover, if / = /C*/i + f2, g = ^*gi + ^2, then 
E(^(/)^((7)) = E(X(/i)X(^?i)) +E(^(/2M(72)) 

= (/C/C*/l, gi)-ii + (/2, 5'2)h = (/C*/l, ^*fi'l)H + (/2, 5'2)h = (/, fi')H, 

where the first equahty follows from the independence of X and 03, and the last, from 
(/C*/i,5'2)h = (A^*fi'i,/2)H = 0. Thus, ?B is a white noise over H, and the proof of 
(12.51) is complete. 

(b) Define Ht^ as the closure of H with respect to the inner product {f,g)uTz = 
iT^f,g)n- For / G H, ||/||h^ = (7^/, /)h < C'||/||h, which implies a dense continuous 
embedding of H into Ht^. By definition, for f,g E H, K(^X{f)X{g)) = (7lf,g)u = 
{f,g)un- As a result, if / G Ht^ and lim„^oo ||/n - /||h^ = 0, with G H, then 

hm E(X(/^)-X(/„))'= hm ||/„.-/n||^^ =0, 

m,n— >oo m,n— >oo 

SO that lim exists in the mean-square and is therefore a Gaussian random 

n— ►oo 

variable. We then define X(/) = lim X(/„). The value of X(/) does not depend on 

n—>oo 

the sequence n > 1} approximating /, because 

lim E(X(/) - XUn)f = 11/ - /nllL = 0- 

n— >oo 

Also, 

E(x(/)X((7)) = lim E(x(/„)X((?„)) = \i^Un,gnW = U.gW^ 

meaning that this extension of X is a white noise over Hn- n 

Remark 2.5. (a) If X is non- degenerate and TZ : H —> H is onto, then TZ has 
a bounded inverse and H-ji = H. (b) If keiTZ is non-trivial, then we can define 
H-ji as the closure of the factor space H/ker(7^) with respect to the inner product 
{f,g)'H.Tz = (JZf,g)ii, where f is the equivalence class of f in H/ker(7^). Direct 
computations show that the generalized random field 03 over H/ker(7?,), defined by 

53(7) = X(/), feu, 

extends to a white noise over Un- 

We will now discuss several connections between generalized Gaussian fields and 
Gaussian processes. In what follows, / denotes either an interval [0, T], or the half-line 
[0,+oo), or all of M. 

Denote by Xt = Xt{s) the characteristic function of the interval [0,t]: 
(2.8) xtis) 



1, 0<s<t; 
0, otherwise. 



With this definition, Xt2{s) — Xti (s) is the characteristic function of the interval (^1,^2], 
t2 > ti. 
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Theorem 2.6. (a) If^ is a white noise over L2{I) , then B{t) = 53(xt) is a standard 
Brownian motion on {Q, JF, P) and, for every f G L2{I), we have 

(2.9) ^U) = jj\s)dB{s). 

(b) For every zero-mean non- degenerate generalized Gaussian field X over L2{I) , there 
exist a bounded linear operator JC* on L2{I) and a standard Brownian motion W = 
W(t) such that, for every f G L2{I), 

(2.10) X{f) = J{IC*f){s)dW{s). 

Proof, (a) Direct computations show that B = B{t) has all the properties of the 
standard Brownian motion. In particular, 

E{B{t,)B{t2)) = f XtAs)Xt,{s)ds = mm{t,,t2). 
Jo 

Next, if sq < Si < ... < sjv is a finite collection of points in / and f{s) = 

N 

(^kiXski^) ~ Xsk-ii^)) is a (non-random) step function, then the linearity prop- 

k=l 

erty of the generalized random field 05 implies 

TV 

^(/) = E«4^(X.J-^(X..-J) = fis)dBis). 
k=i 

For general /, the result then follows after passing to the limit, using the continuity 
property of the generalized random field 03 and the L2-isometry of the stochastic 
integral. 

(b) This follows from part (a) and from Theorem 12.41 □ 



Given a zero-mean generalized Gaussian field X over L2{r), we define its associated 
process X{t), t G /, by 

(2.11) X{t) = Xixt). 

Clearly, X{t) is a Gaussian process. Let JC* be the operator from Theorem 12.61 and 
define the kernel function Kx = Kx{t, s) by 

(2.12) Kx{t,s) = {IC*Xt){s). 
It then foUows from fITTU]) that 

(2.13) X{t) = jKx{t,s)dW{s) 

for some standard Brownian motion W . Let us emphasize that, while every kernel 
K{t^ s) with minimal integrability properties can define a Gaussian process according 
to fl2.13p . only a process associated with a generalized field over L2{I) has a kernel 
defined according to (12.121) . where /C* is a bounded operator on L2{I). Recall that the 
definition of a generalized field (Definition l2.1l) includes a certain continuity property, 
and this property translates into addition structure of the kernel function in the 
representation of the associated process. 
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Now assume that we are given a Gaussian process X{t) defined by (12.131) with some 
kernel Kx{t, s). We are not assuming that Kx has the form In what follows, we 

discuss sufficient conditions on Kx{t, s) ensuring that X{t) is the associated process 
of a generalized Gaussian field X over L2{I), that is, representation (12.121) does indeed 
hold with some bounded linear operator /C* on L2{I). For that, we need to recover 
the operator /C* from the kernel Kx{t,s). By linearity, if (12.121) holds and if sq < 
si < . . . < Sat are points in I and 

N~l 

(2.14) /(^) = E«^(^^^+i(^)-^^^(^)) 

fc=0 

is a step function, then 

N-l 

(2.15) }C*f{s) = J2<'k{Kx{sk+i,s)-Kx{sk,s)). 

k=0 

To extend (12.151) to continuous functions /, the kernel Kx(t, s) must have bounded 
variation as a function of t; if this is indeed the case, then (I2.15P implies that, for 
every smooth compactly supported function / on /, 

(2.16) lC*f{s) = jj{t)Kx{dt,s). 

The assumption about the bounded variation of the kernel is used extensively in [2], 
and the connection with generalized fields shows that this assumption is very natural. 
It now follows that if the partial derivative dKx{t, s) / dt exists and is square integrable 
over I X I, then /C*, as defined by (I2.16p . extends to a bounded linear operator on 

Let us now assume that / = [0,T] and the process X(t) define by (12.130 is 
non-anticipating, i.e. adapted to the filtration {J-"^ , < t < T} generated by the 
Brownian motion W{s). Then Kx{t, s) = for s > t and (I2.13P becomes 

(2.17) X{t)= f Kx{t,s)dW{s). 

Jo 

Note that in this case we have 

/>min{t,s) 

(2.18) E{X{t)X{s))= / Kxit,T)Kxis,T)dT. 

Jo 

This is the type of processes studied in [2], and for such processes, formula (12.151) and 
the conditions for the continuity of the corresponding operator /C* must be modified 
as follows. 



Theorem 2.7. Assume that I = [0,T] and the process X(t) defined by Ii2.13\) is 
non- anticipating. 
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(a) If f is a step function (2J^, then 



N-l 



(2-19) 7-, 

+ ^ ak{Kxisk+i,s) - Kx{sk,s))y 

k=i+l 

(b) If the function Kx{-, s) has bounded variation for every s and lim Kx{s+6, s) = 

<5— >0, <5>0 

Kx{s~^, s) exists for all s G (0,T), then 

(2.20) ]C*f{s) = Kxis-", s)f{s) + fit)Kx{dt, s) 

for every continuous on [0,T] function f. 

(c) If the function Kx{t, s) has the following properties 

(1) K is continuous and non-negative for < s < t < T , and sup K{t,t) < Kq; 

0<t<T 

(2) K^^\t, s) = dK(t, s)/dt is non-negative for < s < t < T and there exists a 
number Ki = Ki{T) such that 

(2.21) sup [ K{T,s)K'^^\t,s)ds < Ki{T), 

0<t<T Jo 

then the corresponding operator IC* defined by equation (12.201) is bounded on -C/2((0, T)) 
and the operator norm ||/C*|| of K* satisfies 



(2.22) ||/C*f < 



2(^2 + 7^1), ifiro>0; 
7^1, if 7^0 = 0. 



Proof, (a) By assumption, Kxit, s) = for s > t. Fix an s such that s G {sj, s^+i] 
for some j = 0, . . . , — 1. By f l2.15p we have for this value of s 

N-l 

^*f{s) = ^ ak{Kx{sk+i, s) - Kx{sk, s)) 

k=0 

N-l 

= ajKxisj+us) + ^ ak{Kxisk+us) - Kxisk,s)). 

k=j+i 

Since Xsk+ii^) ~ Xski^) is the characteristic function of the interval {sk,Sk+i], (12.191) 
follows. 

(b) Under the additional assumptions on the kernel Kx, (I2.20p follows from (12.191) 
after passing to the limit max — s,! — > 0. 

i=0,...,7V-l ' ^ 

(c) Let ghe a. smooth compactly supported function on (0,T). It follows from (12.201) 
that 

lC*g{s) = K{s, s)g{s)ds+j^^^^^ g{T) dr = K{s, s)gis)ds+ K^'\t, s) gir) dr. 



10 S. V. LOTOTSKY AND K. STEMMANN 

To estimate the L2-norm of the integral, we use the Cauchy-Schwartz inequahty and 
the properties of K^^^: 







K^^\T,s)g{T)dT 



ds= f [ [K^'\r,s)f'[K^'\r,s)Y^%{T)dT 

Jo J s 



ds 



<[ [ K^^\T,s)dT [ K^^\T,s)g^{T)dT ds 

Jo Js J s 

< / {K{T,s) - K{s,s)) / K^^\T,s)g\T)dr ds 

Jo Js 

< j^^ {^j\{T,s)K^'\r,s) ds^ g\r) dr < K,{T)\\g\\% 



L2i(0,T))- 

□ 



We remark that in [2J relation fl2.19p is used to define the operator JC* corresponding 
to a non-anticipating process X{t). Using the connection with the generalized fields, 
Theorem 12.71 shows that this definition is reasonable. 

The main example covered by part (c) of Theorem 12.71 is the fractional Brownian 
motion on [0,T] with the Hurst parameter H > 1/2. Indeed, it is known (see 
[T5l Section 5.1.3]) that in this case has representation fl2.17p with 

Kx{t, s) = Ch{h- j\T - .)^-tr^-^ dr, 

where 

c -( 
^ \r {H + l)r{2-2H) 

and r is the Gamma-function. Clearly, Kx{s, s) = and so Kq = 0. Then somewhat 
lengthy computations show that 

(2.23) K,{T) = ^^^^ - T^^-\ 

The bound Ki{T) is asymptotically optimal: since lim xT{x) = lim r(l + a;) = 1, 

the right-hand side of (12.231) converges to 1 as \ |, and if H = 1/2, then is 
the standard Brownian motion and /C* is the identity operator, which corresponds to 
||/C*|| = 1. 

The following theorem establishes a connection between a zero-mean Gaussian process 
and white noise. 

Theorem 2.8. For every zero-mean Gaussian process X = X{t), t G / C M with 
covanance function R{t,s) = E{X{t)X{s)), th ere exist 

(1) a Hubert space Hr containing the indicator functions Xu 

(2) a white noise 03 over H/j 



such that X{t) = 23 (xt). 
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Proof. Let the Hilbert space Hr be the closure of the set of the step functions with 
respect to the inner product 

Define a generahzed Gaussian field 03 over by setting 
(2.24) ^{xt)=Xit), 

and then extending by linearity and continuity to all of H/j. With this definition, ^ 
is a white noise over Hji. □ 

By analogy with (12.91) . if X is a generalized Gaussian field over a Hilbert space H of 
functions or generalized functions on /, and X{t) is the associated process of X, then 
Jj f{s)dX{s) can be an alternative notation for X(/). 

The space H/j from Theorem 12.81 appears in [2| and is different from reproducing 
kernel Hilbert space used in [161 Section 6]. If X(t) is the associated process of a 
zero- mean non-degenerate generalized Gaussian field X over H = L2{I), and TZ is the 
covariance operator of X, then R{t,s) = {'R'Xt,Xs)L2{i) and the space Hr coincides 
with Ht^ from Theorem 12.41 

Given a covariance function R, an explicit characterization of the space H^^ is impos- 
sible without additional assumptions about R. For example, in [2], representation 

/•min{t,s) 

R{t,s) = / K{t,T)K{s,T)dT, 
Jo 

is used, along with various assumptions about the kernel K. If / = [0, T] and R{t, s) = 
min(t, s), then {xti,Xt2)HR = {Xh,Xt2)L2{{o,T))- That is, for the Wiener process, = 
^2((0,T)). 

Let us summarize the main results of this section: 

• Every zero-mean generalized Gaussian random field over H with covariance 
operator TZ has two white noise representations: over the Hilbert space Hn 
and over the original space H; 

• Every zero-mean Gaussian random process with covariance function R is the 
associated process of a white noise over the Hilbert space Hr. 

3. Chaos Decomposition and the Wick Product 

Let X be a zero-mean generalized Gaussian field over a real Hilbert space H, on a 
probability space {fl, J^, P). From now on, we assume that the space H is separable. 
Denote by JF-^ the sigma-algebra generated by the random variables X(/), / G H. 

Definition 3.1. (a) The chaos space generated by X is the collection of all random 
variables on {Q, JF, P) that are square integrable and J^^ -measurable. This chaos 
space will be denoted by H^. 

(b) The first chaos space generated by X is the sub-space ofMx, consisting of the 
random variables 3C{f), / G H. The first chaos space will be denoted by H^"*. 
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It follows that Hx is a Hilbert space with inner product ri)^^ = ^{^rj), and H^'* is 
a Hilbert sub-space of M.x- Moreover, the space H^^ is separable: if {/i, /2, . . .} is a 
dense countable set in H, then the collection of all finite linear combinations of 
with rational coefficients is a dense countable set in EI^\ 

Our next objective is to show how an orthonormal basis in H^"* leads to an orthonor- 
mal basis in H^. We will need some additional constructions. 

For an integer n > 0, the n-th Hermite polynomial Hn = Hn(t) is defined by 
(3.1) H^it) = (-l)VV2|-e-*V2. 

In particular, Ho{t) = 1, Hi{t) = t, H2{t) = - I, H^^t) = - 3t, etc. Note that 
Hn{t) = + . . ., that is, Hn is a polynomial of degree n and the leading coefficient 
is always equal to one. It is well known that if ^ is a standard Gaussian random 
variable, then 



(3.2) E{HniOHmiO) 



n = m; 
n ^ m. 



In fact, the collection {Hn{^), n > 0} is an orthonormal basis in the space of square 
integrable, J-'^-measurable random variables. 

Next, denote by X the collection of multi-indices, that is, sequences a = {ak, k > 
1} = {ai, ^2, . . .} with the following properties: 

• each ak is a non-negative integer: ak G {0, 1,2,...}. 

oo 

• only finitely many of ak are non-zero: |a| := ^ < oo. 

k=l 

The set I is countable, being a countable union of countable sets. By e„ we denote 
the multi-index a = {ak, k > 1} with = 1 if n = and = otherwise. For 
a G i7, we will use the notation 

a\ := ai! 0:2! ■ ■ • 

Let {^1,^2, • • •} be an ordered countable collection of random variables. For a G X 
define random variables C,a as follows: 



(3.3) ea = n 



k>l v«fc! 

where Ha,, is afc-th Hermite polynomial (13. ip . For example, a = (0, 2, 0, 1, 3, 0,0,.. .) 
has three non-zero entries 02 = 2, 04 = 1, and as = 3, so that 

The product on the right hand side of (13.31) is finite for every a G X. Note also that 
^k = Hi{^k) = ^Efe and, more generally, Hn{^k) = Vr^-^nek- 
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The following theorem has been known for some time in various forms. In the par- 
ticular case when X{f) = f{t)dW{t), this theorem is the main result of the paper 
[1] by Cameron and Martin; see also [U Theorem 1.9] and [TOj Theorem 2.2.3]. The 
formulation and proof below are similar to [TU Theorem 2.1]. 

Theorem 3.2. Let {^i,^2; • • •} be an orthonormal basis in . Then the collection 
H = {^Q,, a G X} zs an orthonormal basis in M.^: for every rj G Mx we have 

Proof. Recall that X is a Gaussian random field. As a result, an orthonormal basis 
in EI^'' is a collection of standard Gaussian random variables ^k, k > 1, that are 
uncorrelated, hence independent. Then property (13. 2p of Hermite polynomials implies 
that S is an orthonormal system. 

Next, denote by H^^ the Hilbert space of square integrable random variables that are 
measurable with respect to the sigma-algebra generated by ^fc. Consider the product 

oo 

space Hoo = Yl ^(k- By the definition of the product topology, it follows that the 

k=l 

collection {^a, a G X} is an orthonormal basis in this product space. We also note 
that, by construction, the sigma-algebra is generated by the random variables 
^i,.^2, • • • , and therefore, for every jF-^-measurable random variable rj, there exists a 
measurable, real-valued function F on the measurable space with the 

property rj = ^2, • • •)• This establishes a one-to-one correspondence between the 
product space and the chaos space H^, and completes the proof. □ 

By definition, the space H^'' is generated by C,a with |a| = 1. More generally, we 
define the N-th chaos space of X, as the closure in Mx of the linear span of 

with |a| = A^: rj E H^"* if and only if 77 = ^ c^^o for some real numbers Cq, 

aeJ,\a\=N 

satisfying |cq,P < 00. By Theorem 13.21 we have the chaos decomposition of Hx: 

00 

(3.4) = ^'x^ = © ^''x © © • ■ ■ . 

7V=0 

Proposition 3.3. For each N, the space H^-* does not depend on the choice of the 
basis in EI^'' . 



Proof. Since the polynomials Hq, Hi, . . . , are orthogonal with respect to the 
Gaussian measure on M, these polynomials are linearly independent. Therefore, for 
each > 0, the space E[|^ = H^'' © M^^^ © ■ ■ ■ © coincides with the closure in 
M.X of the linear span of the random variables P/v(X(/i), . . . , X(/fc)), > 1, G H, 
where is a polynomial of degree at most A^; cf. [HI p. 9]. Thus, the space ]Hl|^ 
does not depend on the basis in H^"* . Since El|^ = H^*-^ © H^'' , the space 
does not depend on the basis as well. □ 
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In the case of white noise ^ over H, an orthonormal basis in H^g is closely related 
to an orthonormal basis in H. 

Proposition 3.4. Let ^ be a white noise over a separable Hilbert space H and let 
{mi, m2, • • •} be an orthonormal basis in H. Then {C,k = 23 (m^), k > 1} is an 
orthonormal basis in M.^^ and, for every / G H, 

oo 

(3.5) ®(/) = 5^(/,mfc)H^(mfc). 

k=l 

Proof. Note that lE(^fc^n) = IE(!B(m,fc)!B(m„)) = (mfc,m„)H, so the system {^fc, k > 
1} is orthonormal in EI^'* if and only if {m^, A; > 1} is orthonormal in H. If ^ G IHll^'', 
then ^ = 53(/) for some / G H. By assumption, / = J2'k'=iif^ ^k)H f^k, which implies 
03.51) and completes the proof. □ 



If H = L2((0,T)) and / = Xt, then (13.51) becomes a familiar representation of the 
standard Brownian motion on [0,T]: 



(3.6) W{t) = Yl{l ^k{s)ds^ (^j^ mk{s)dW{s)^ . 

Now, let X be a zero-mean generalized Gaussian field over a separable Hilbert space 
H. By (13.51) and Theorem 12.4( a). we can take a white noise representation of X, 
X(/) = ?B(/C*/), and get an expansion of X(/) using an orthonormal basis in H: 

oo 

(3.7) X(/) = ^(/C7,mfc)H^(m,). 

k=l 

When H = L2((0,T)) and / = Xt, the associated process has representation X{t) = 
Kx{t, s)dW{s), where Kx{t, s) = {IC*Xt){s), and we get a generalization of (13.61) : 

(3.8) X{t) = (^j\}Cmk){s)ds^ (^j\k{s)dW{s)^ ; 
note that j^{K,mk){s)ds = Kx{t,s)mk{s)ds. 

Alternatively, by Theorem 12.4( b) and Remark 12.5( b). X is a white noise over the 
space Ht^ corresponding to the covariance operator 71 of X. If {frik, > 1} is an 
orthonormal basis in H-jz, then we have the following analog of (13.51) : 



(3.9) X(/) = ^(7^/,m,)HX( 



TUk). 



k=l 



If X is non-degenerate, which means ker(7?,) = 0, then (13.71) and (13.91) are equivalent. 
Indeed, by Theorem 12.4( b). H is dense in Uti and we can extend JC* to a bounded 
linear operator from Ht^ to H, because ||/C*/||h = II/IIhtj- Clearly, (13. 7p and (13.91) 
coincide for / G H, since {]C*fnk,k > 1} is an orthonormal basis in H. Extending 
( K7h to / G Ht^ makes equivalent to CT . 
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We conclude the section with a brief discussion of the Wick product, as we will need 
this product to define for random /. 

To motivate the definition of the Wick product, we make the following observation. 
The ordinary powers x" have the property x^x"^ = x"*"*"". By Theorem 13. 2[ the 
natural building blocks of the chaos space M.x are not the ordinary powers but Hermite 
polynomials of the basis elements in M^^\ It is therefore convenient to have an 
operation, which we denote by o and call the Wick product, so that, for every ^ G 

(3.10) Hn{OoHUO=Hm+n{0- 

In fact, together with Theorem 13.21 relation (13.101) completely defines the Wick prod- 
uct in Hx, because if {^q, a e X} is an orthonormal basis in Hx, as defined by (\3.3L 
then, for a = {ak, k > 1} and P = {Pk, > 1} we have 



(3.11) ^"^^^ = 

where a + P = {ak + Pk, ^ > 1} and a\ = Y[k>i ^k^- ~ C(i^-C(2^-C(3^- ■ ■ ■ ■ Using (13. lip and 
linearity, we now define the Wick product of two arbitrary elements of H^, 



(3-12) f E o f E d^^^) = E ''^dJ ^' 

as long as the series on the right hand side converges in EI^. In general, there is no 
guarantee that, for ^,1] & H^, the Wick product C,oi] belongs to M.x- For example, let 
^ G H^'', E^^ = 1, and rj = Xl^i Hn{^) / {nVnJ.) . Then, treating ^ as the first element 
of the orthonormal basis in M.^^\ we have ^ = = and t] = Yln>i''^~^^nei- Then, 
by p. lip, 6 o^„,^ = ^/n + ^(n+l)el, so that 

Vn+l 



n 

n=l 



and the series does not converge in Mx- 

Note that, unlike the usual product, the Wick product of two random variables must 
be computed using the chaos expansion (I3.12p . The lack of an easy criterion for the 
convergence in (I3.12p is one reason for considering weighted chaos spaces. In the 
case when X is a white noise over L2(M"), weighted chaos spaces are described, for 
example, in the books [9] and [lO] (see also |13]). The extension of these spaces to 
other Gaussian fields is straightforward, but is outside the scope of our discussion. 

Let us summarize the main properties of the Wick product: 

• ^o(r/oC) = (^077)oC; 
•^o(^ + C)=^o^ + ^oC; 

m ^o-q = ^T] a ^,r] e H^^^ and E(^r/) = 0. 

• ^ '^V = either ^ or 77 is an element of M.^^^ , that is, non-random. 
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Similar to ordinary powers, we define Wick powers of a random variable rj G Mx'- 
^on _ fj o ■ ■ ■ o rj. Replacing ordinary powers with Wick powers in a Taylor series 
for a function / leads to the notion of a Wick function For example, the Wick 
exponential e^^ is defined by 

(3.13) ^" = E^ 

n=l 

and satisfies e**-^^''-' = e*^ oe*''. If 77 G H^"*, then direct computations show that 

(3.14) e^'' = e''->'. 
For more information on the Wick functions, see |10j . 

Just as the chaos decomposition (13. 4p . the Wick product doest not depend on the 
choice of the orthonormal basis in H^''. For example, if rji, . . . ,7]^ are elements of 
m^^^ and mi, . . . , mfc are non-negative integers, then r^^™^ o- ■ ■0%'"'' is the orthogonal 
projection of 11^=1 V^^ o^i^o H^'', where N = nii + ■ ■ ■ + nik- For more details, we 
refer to P [JOl [H] . 



4. Stochastic Integration 

In the definition of a generalized random field X over a Hilbert space H, we consider 
random variables 3£(/) for non-random / G H. In this section, we define ^(r]) for 
H-valued random elements r]. 

As a motivation, consider a white noise ?B over L2((0,T)). By Theorem 12.61 W{t) = 
*B(xt) is a standard Brownian motion; according to (13. 6p . 

00 

(4.1) w{t) = j2Mkmk, 

k=l 

where = ^('^fc)? ^^{t) = j^mk{s)ds, and {m^, > 1} is an orthonormal basis 
in L2((0,T)). Being a continuous function, W = W(t) is an element of L2((0,T)). 
To define ^ on W using (jH]), one possibility is to set ^°{W) = Efcli^fe^(^fc); 
then direct computations show that YlkLi^k'^Si-^k) = W'^(T)/2. In other words, 
Q5°(iy) = W{t) o dW{t), where o denotes the Stratonovich integral. Another 
possibility is to set ^^{W) = YlT=i ^ ^i^k)', then direct computations show that 
E^i^fcO'S(Mfc) = (?B(T)2 - T)/2. In other words, Q3^(IV) = J^W{t)dW{t), the 
Ito integral. 

We will now use this example to define stochastic integrals with respect to a white 
noise 03 over a separable Hilbert space H. Let {m^, > 1} be an orthonormal basis 
in H. Define C,k = '18 {nik) and ^q,, a G X, according to (13. 3p . 

Definition 4.5. An H-valued random element t] is called (05, H)-adinissible if 

^II^IIh < ^ Z^'" every / G H, i/ie random variable {rj, /)h -measurable. 
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By Theorem 13.21 and Proposition 13. 4[ every (*B, H)-admissible t] has chaos expansion 

(4.2) V=Y1 = ^(^^") ^ 

Definition 4.6. Let rj be {^,11) -admissible with chaos expansion \4-2^ - 
The Ito stochastic integral of 7] with respect to *B is 

(4.3) ?B^(77) = 5^^(r7«)oea, 

where o is the Wick product. The Stratonovich stochastic integral of rj with 
respect to 23 is 

(4.4) Q5°(r7) = ^^(r^,)-e., 

where ■ is the usual product. 

Since every generahzed Gaussian field and every Gaussian process can be represented 
as a white noise over a suitable Hilbert space, formulas (14. 3 p and (14. 4p define stochastic 
integral with respect to any Gaussian process or field. We will see below that these 
formulas also provide a chaos expansion of the integral in terms of the chaos expansion 
of the integrand; note that neither (14.31) nor (14. 4p is a chaos expansion in the sense of 
( 14. 2p . The two immediate question that are raised by the above definition and will 
be discussed below are (a) the convergence of the series, and (b) the dependence of 
the integrals on the choice of the basis in H. 

We start by deriving the chaos expansion of the integrals without investigating the 
question of convergence. 

Theorem 4.7. Let rj be {^,11) -admissible with chaos expansion i4.2^ , and assume 
that 

oo 

(4.5) 'na = '^'na,kfnk. 

k=l 

Then 

(4.6) ^'(v) = E ( E v^^"-.,'^ ) 

ael \k=l J 

(4.7) m°{ri) = E I E {V^Va-e^^k + Va^TTVa+ek,k) J ^a- 

ael \k=l / 

Proof. By (14. 5 P and linearity, 

oo oo 

^iVa) = ^r]a,k^{fnk) = '^r]a,k^k- 
k=l k=l 

Therefore, 

oo oo 

(4.8) ?B^(r7) = EE^"'*=^'^^^" = EE^"'^ + ^^"''^^"+^^' 

aeX k=l oSX k=l 
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where the last equahty follows from (13. lip : recall that is the multi-index with the 
only non-zero entry, equal to one, at position k. By shifting the summation index, 
we get (14. 6p Note that, for every a G X, the inner sum in (14. 6 p contains finitely many 
non-zero terms. 

To establish (14. 7p . we write, similar to (14.80 . 

oo 

ael k=l 

and, instead of (13. lip , use the following property of the Hermite polynomials, 

Hi{x)Hn{x) = Hn+i{x) +nHn-i{x), 

which implies 



(4.9) ae. = ( n ""^^^'l^^^^'^ = v^a.. + v^e 



and then (ITTIl follows. □ 

Now, let us address the questions of convergence and independence of basis. The 
Cauchy-Schwartz inequality implies that if 

(4.10) ^W\\\'na\\li<0O, 

then Q3*(r7) G Hsb. Further examination of (14.60 shows that, for every (03, H)- 
admissible t] satisfying (I4.10p . *B^(?7) coincides with the action of the divergence 
operator (adjoint of the Malliavin derivative, see [T^) on rj and therefore does not 
depend on any arbitrary choices, such as the basis in H. In particular, if H = L2{I), 
then Q5^(?7) is the Ito-Skorokhod integral of rj. On the other hand, (14. 6 p allows the 
extension of OS* to weighted chaos spaces, similar to those considered in [9l HOl [13]. 

For the Stratonovich integral ^°{ri), note that the Mallivain derivative D of C,a satisfies 

oo 
k=l 

this follows directly from the definition of D [15^ Definition 1.2.1] and the relation 
H'^{x) = nHn-i{x). As a result, we use (14. 9 p to re-write (14.70 as 

(4.11) ®°(r/) = ^%r]) + J2iVa, BUn. 

In particular, if 03 is a white noise over L2{I) and 1] = ri{t) is in the domain of the 
Malliavin derivative, then 



(4.12) ^°{r]) = ^%T]) + J Bt7]dt, 

where 

/ oo 



ael \k=l 
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ulnlike the Ito integral, though, condition f l4.10p is not enough to ensure the existence 
of ^°(?7) as an element of M.x- When H is the Hilbert space of functions on an interval 
/, square integrable with respect to a (not necessarily Lebesque) measure /i, the 
sufficient conditions for the Stratonovich integrability are discussed in p3| Chpater 
3]. Alternatively, 03° can be defined in weighted chaos spaces, but the details of the 
construction have yet to be worked out. 

In what follows, we will concentrate on the Ito integral. 

Let X be a zero-mean non-degenerate generalized Gaussian field over a separable 
Hilbert space H. As we mentioned earlier, by the second part of Theorem 12. 4[ X is a 
white noise over a bigger Hilbert space Ht^, and then X*(?7) can be defined using fl4.3p . 
If the space Ht^ is difficult to describe, one can use representation (12. 5p from the first 
part of Theorem 12.41 and consider a different formula for the stochastic integral: 

(4.13) X%r]) = ^\lCri) 

for every (03, H)-admissible rj. Similar to the non-random integrands, the two defini- 
tion are equivalent if X is non-degenerate. 

Unlike (14. 3p . representation (14.130 is not intrinsic: the operator K* and the white noise 
*B are not uniquely determined by X. On the other hand, in many examples, such as 
fractional Brownian motion with the Hurst parameter bigger than 1/2, it is possible 
to take H = L2{I), and then (I4.13P becomes more convenient than (14. 3p . To derive 
the chaos expansion of X*(?7) using (14.130 . fix an orthonormal basis {m^. A; > 1} in 
H, define = 03(mfc), and consider the corresponding orthonormal basis {^q, a E 1} 
in Htg constructed according to (13.30 . It follows from (14. 6 p that 



(4.14) X^(77) = 5^ I 5^ V^kVa-.,,k ] U 

where 



r]k,a = E[{}C*r], mfc)H Ca) • 
If = L2{I), then IKI^ becomes 

(4.15) xtiv) = E va-eAm^kmdt\ ) e 



where riait) = K(^ri(t) ^a) ■ In this case, by analogy with the Brownian motion, 
r]{s)dX{s) can be an alternative notation for X^{r]), where X{t) is the associated 
process of X. 

We conclude this section with a brief discussion of stochastic differential equations. 
To introduce the time evolution, we use the function xt, the characteristic function 
of the interval [0,t], and define time-dependent stochastic integrals 

(4.16) ■■= ^^te), ^tiv) ■■= ^\vXt)- 

These definitions put an obvious restriction on the Hilbert space H, which we call 
Property I: H a collection of function or generalized functions and, for every 77 G H 
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and every fixed t, the (point-wise) product rjxt is defined and belongs to H. There is 
a more significant restriction on H, which we illustrate on the following equation: 

(4.17) u{t) = 1 + «B^(m), < t < T, 

where *B is white noise over a Hilbert space H with Property I. Let us assume that 
the solution belongs to Ms^ so that u(t) = J2a€i '^aif)ia and each is an element of 
H. By (14.161) . we can re- write f l4.17p as 

(4.18) M(t) = l + ?B^(MXt), 
and then ( 14. 6p implies 

oo 

(4.19) Ua{t) = 1 + y^^Ug-^^Xt, mk)-R. 

k=l 

Thus, the expression (wa-efcXt; '^A;)h, as a function of t, must be an element of H, 
and the Hilbert space H must have another special property, which we call Property 
II: for every f,g EH, the inner product {fxt,g)'H., as a function oft, is an element 
o/ H. By the Cauchy-Schwartz inequality, the space L2 (/,//), with //(/) < 00, has 
both Property I and Property II. Representation (14.131) then allows us to analyze 
stochastic equations for certain generalized Gaussian fields. This analysis should be 
a subject of a separate paper, and below we consider only one particular example. 

Theorem 4.8. If X is a zero-mean generalized Gaussian field over L2{{0,T)), then 
the solution of the equation 

(4.20) u{t) = 1 + X^iu) 
is unique in L2((0, T); H^) and is given by 

(4.21) M(t) = e^^W, 

where is the Wick exponential function Ii3.13\) and X(t) = X{xt) is the associated 
process ofX. 



Proof. Let X(f) = *B(/C*/) be a white noise representation of X over L2((0,T)). We 
start by establishing uniqueness of solution in L2((0, T); Hig), which, because of the 
inclusion C Hsg, is even stronger. By linearity, the difference Y{t) of two solutions 
of (Km satisfies Y{t) = X^(F). If Y{t) = ^ ya{t)^a, then fHA5|) implies 

(4.22) l/a(^) = ^v^/ ya-ek{s)mk{s)ds, 

k>l -^0 

where = /Cm^. In particular, if |a| = 0, then ya{t) = for all t. By induction 
on ya{t) = for all a G X: if ?/q, = for all a with |a| = n, then, since 
|a — e/cl = |a| — 1, equality f l4.22p implies ?/a = for all a with |a| = n + 1. 

To establish fH:2TD . let 

Mfc(t) = / {}Cmk){s)ds. 
Jo 
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By (ESD, 

oo 

X(t) = 5^Mfc(t)6, 

k=l 

and, because of the independence of for different k, 

k>l aeX 

where 

oo 
k=l 

Similar to fl4.22p . we conclude that if the solution u = u{t) has the chaos expansion 
u(t) = Uait)C^a, then Ua(t) = 1 if |a| = and 

(4.23) Ua{t) = ^y/a^j Ua-ef,{s)rhk{s)ds, 

k>i 

if I a I > 0. Then direct computations show that 

u^{t) = \a\ > 1, 

satisfies g^Sl): 



dt V^.dt--^ v«!,=i 

= > i/afc TTifc (t) , = } y/ak nik [tjUa-Sk (^) • 

k=i V("-^fc)! tit 



□ 



Theorem 14.81 is a generalization of the familia result that the geometric Brownian 
motion u{t) = e^W-^*/^) = e<>^W satisfies u{t) = 1 + J^^ u{s)dW{sy. by fICTD and 
fl3.14p . for a class of zero- mean Gaussian processes X = X{t) with covariance function 
R(t,s), and with a suitable interpretation of the stochastic integral, the solution of 
the equation u{t) = 1 + J^^ u{s)dX{s) is 

M(t) = e^W-^^(*'*). 

The proof of the theorem suggests that stochastic equations in the Ito-Skorokhod 
sense are more suitable for analysis using chaos expansion than the equations in the 
Stratonovich sense. Indeed, equation fl4.20p leads to the system of equations (14.231) 
that is solvable by induction on By contrast, equation u(t) = 1 + X°(m) leads to 
a system that is not solvable by induction on |a|: according to (14. 7p . Ua will depend 

on both Ua-eu and Ua+e,.- 
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The arguments used in the proof of Theorem 14.81 can be extended to more general 
hnear equations and to generahzed fields over L2((0,T),/i) for different measures /x, 
although the precise results will essentially depend on certain fine properties of /i. 
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